Claims 

[cl] 1 . A method for representing the latent semantic content of a plurality of 

documents, each document containing a plurality of terms, the method 
comprising: 

deriving at least one n-tuple term from the plurality of terms; 

forming a two-dimensional matrix, 

each matrix column c corresponding to a document, 

each matrix row r corresponding to a term occurring in at least one document 
corresponding to a matrix column, 

each matrix element (r, c) related to the number of occurrences of the term 

corresponding to the row r in the document corresponding to column c, 

at least one matrix element related to the number of occurrences of one at least 

one n-tuple term occurring in the at least one document, and 

performing singular value decomposition and dimensionality reduction on the 

matrix to form a latent semantic indexed vector space. 

[c2] 2. The invention as recited in Claim 1 further comprising: 

identifying an occurrence threshold; 

wherein n-tuples that appear less times in the document collection than the 
occurrence threshold are not included as elements of the matrix. 

[c3] - 3. The invention as recited in Claim 1 wherein the occurrence threshold is two. 

[c4] 4. The invention as recited in Claim 1 wherein deriving at least one n-tuple term 

further comprises: 

creating the at least one n-tuple term from n consecutive verbatim terms. 

t c5 ] 5. A method for determining conceptual similarity between a subject document 

and at least one of a plurality of reference documents, each document 
containing a plurality of terms, the method comprising: 
deriving at least one n-tuple term from the plurality of terms, 
forming a plurality of two-dimensional matrices wherein, for each matrix: 
each matrix column c corresponds to a document, one column corresponding to 
the subject document; 

each matrix row r corresponds to a term occurring in at least one document 
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corresponding to a matrix column, 

each matrix element (r, c) represents the number of occurrences of the term 
corresponding to r in the document corresponding to c; 
performing singular value decomposition and dimensionality reduction on a 
plurality of formed matrices, to form a plurality of latent semantic indexed 
vector spaces, 

the latent semantic indexed vector spaces including at least one space formed 
from a matrix including at least one element corresponding to the number of 
occurrences of at least one n-tuple term in at least one document, 
determining at least one composite similarity measure between the subject 
document and at least one reference document as a function of a weighted 
similarity measure of the subject document to the reference document in each 
of a plurality of indexed vector spaces. 

[c6] 6. The method as recited in Claim 5 wherein the similarity measures from vector 

spaces comprising greater numbers of n-tuples are weighted greater than 
similarity measures from vector spaces comprising lesser number of n-tuples. 

[c7] 7. A method for representing a query document, the query document containing 

verbatim terms, the query document intended for querying a collection of 
reference documents via a latent semantic indexed representation of the 
reference collection; the method comprising: 
identifying verbatim entities; 
stemming identified entities; 
generalizing stemmed entities; and 

supplementing verbatim entities with corresponding generalized entities. 

[c8] 

8. A method for representing a query document, the query document containing 
verbatim terms, the query document intended for querying a collection of 
reference documents via a latent semantic indexed representation of the 
reference collection; the method comprising: 
identifying verbatim entities; 
stemming identified entities; 
generalizing stemmed entities; and 
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replacing verbatim entities with corresponding generalized entities. 

[c9] 9. The method as recited in Claim 8 wherein verbatim entities comprise ordered 

terms between stop words. 

[cl 0] 1 0. The method as recited in Claim 8 wherein generalizing entities further 

comprises alphabetically ordering stemmed entities as an aid to generalization. 

[cl 1 ] 11. The method as recited in Claim 8 wherein generalizing entities further 

comprises ordering stemmed entities as a function of the frequency of 
occurrence of verbatim entities. 

[cl 2] 12. The method as recited in Claim 8 wherein generalized entities are identified 

with human feedback. 

[cl 3] 1 3. The method as recited in Claim 8 wherein generalized entities are identified 

by automated process. 

[cl 4] 14. A method for characterizing the results of a query into a latent-semantic- 

indexed document space, the query comprising at least one term, the results 
comprising a set of document identities; the method 
comprising:_Ref532030037 

ranking results as a function of at least the frequency of occurrence of at least 
one term. 

[cl 5] 1 5. The method as recited in Claim 14 wherein at least one term used in 

ranking is a query term. 

[cl 6] 1 6. The method as recited in Claim 1 5 wherein the at least one query term used 

in ranking is a generalized entity. 

[cl 7] 1 7. The method as recited in Claim 14 wherein the at least one term used in 

ranking is a generalized entity. 

C cl 8] 1 8. A method for determining conceptual similarity between a query document 

and at least one of a plurality of reference documents, each document 
comprising a plurality of verbatim terms, the reference documents indexed into 
a latent semantic index space, the method comprising;„Ref532038902 
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identifying verbatim entities; 
stemming identified entities; 
generalizing stemmed entities; 

replacing at least one verbatim entity with the corresponding generalized entity 
to form a generalized query; 

identifying a set of reference documents based on closeness, within the latent 
semantic indexed space, between the generalized query and each reference 
document; and 

ranking a subset of closest identified documents as a function of at least the 
frequency of occurrence of at least one term. 

[cl 9] 1 9. The method as recited in Claim 1 8 wherein at least one term used in 

ranking is a query term. 

[c20] 20. The method as recited in Claim 1 9 wherein the at least one query term used 

in ranking is a generalized entity. 

[c21 j 21 . The method as recited in Claim 1 8 wherein the at least one term used in 

ranking is a generalized entity. 

^ c22 ^ 22. A method for representing the latent semantic content of a plurality of 

documents, each document containing a plurality of verbatim terms, the 
method comprising: 

deriving at least one expansion phrase from the verbatim terms, 
each expansion phrase comprising terms; 

replacing at least one occurrence of a verbatim term having an expansion 

phrase with the expansion phrase corresponding to that verbatim term; 

forming a two-dimensional matrix, 

each matrix column c corresponding to a document; 

each matrix row r corresponding to a term; 

each matrix element (r, c) representing the number of occurrences of the term 
corresponding to r in the document corresponding to c; 

at least one matrix element corresponding to the number of occurrences of one 
at least one term occurring in the at least one expansion phrase, and 
performing singular value decomposition and dimensionality reduction on the 
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matrix to form a latent semantic indexed vector space. 

[c23] 23. A method for representing the latent semantic content of a plurality of 

documents, each document containing a plurality of terms, the method 
comprising: 

identifying at least one idiom among the documents, 
each idiom containing at least one idiom term; 
forming a two-dimensional matrix, 
each matrix column corresponding to a document; 

each matrix row corresponding to a term occurring in at least one document 
represented by a row; 

each matrix element representing the number of occurrences of the term 
corresponding to the element's row in the document corresponding to element's 
column; 

at least one occurrence of at least one idiom term being excluded from the 
number of occurrences corresponding to that term in the matrix, 
performing singular value decomposition and dimensionality reduction on the 
matrix. 

[c24] 24. a method for representing the latent semantic content of a plurality of 

documents, each document containing a plurality of terms, the method 
comprising: 

identifying at least one idiom among the documents, 
each idiom containing at least one idiom term; 

replacing at least one identified idiom with a corresponding idiom elaboration, 

each elaboration comprising at least one elaboration term, 

forming a two-dimensional matrix, 

each matrix column corresponding to a document; 

each matrix row corresponding to a term; 

each matrix element representing the number of occurrences of the term 
corresponding to the element's row in the document corresponding to element's 
column, 

at least one matrix element corresponding to the number of occurrences of an 
elaboration term in a document corresponding to a matrix column; 
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performing singular value decomposition and dimensionality reduction on the 
matrix. 



o 
m 
m 
m 
w 
m 

fin 

y 

H 

ry 
o 

ill 

o 



APP ID=09683263 



Page 30 of 36 



